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ABSTRACT 

An evaluation of the laboratory science program 
developed in the Clover* South Carolina, Middle School produced the 
following results; (1) Although the general attitude toward science, 
according to the attitude scale* appeared to be declining in both 
groups, the experimental groups showed a more positive attitude 
towar 3 science than did the control group; (2) The attitude toward 
science did not appear to differ across grades; (3) The experimental 
group showed higher achievement test scores than the control group; 
(4) It appeared that the control group was making ”normil M progress 
and (5) It appeared that the experimental group was making 
above-average gains in performance. These gains were linear and 
cumulative. (Author/CP) 
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The information on the following pages is the evaluation of the sec 
of a three year pridj|ect designed as a demonstration program to create; 
an awareness and a! willingness to try non-convent ional methods and ; tech- 
niques iti teaching elementary science in the Clover School District. ; 

Specific goals of ijtihe project were (1) to increase science achievement 
among fifth, sixth -and seventh grade pupils of the Clover Middle. Sqhooj. 
and (2) to determine the degree to which student attitudes about science 
changed as a result of teaching science concepts by the laboratory ; tech- 
nique. 

A teacher-codijdinator has been employed through the project by the 
Clover School District who has the major responsibility for the conduct 
of project activities. A teacher aide has been provided for the program 
through the use oil local funds. During the 1969-1970 school year a program 
outline was developed by teachers and Science coordinator which outlines 
the program for teaching science concepts by laboratory techniques for 
students in grades four, five, and six in the Kinard Elementary School. 

This guide was published during July, 1970 and distributed to teachers in 
the district for! use. During the summer 1970, a program outline was developed 
:for seventh grade: students and was utilized daring the 1970-71 school year. 

Due to a district . reorganization the program was changed from Kinard 
Elementary School to the Clover Middle School. Students in the 1970-71 
experimental classes (5-6-7) were students who had been enrolled in the 
experimental classes the previous year (4-5-6>, In addition a- variety of 



materials; for laboratory science study 



and utilized. 
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have been identified, developed 
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A. Process Evaluation 






The process 

« 1 

personnel, S. C. 
consultant. 

The superint 
of Clover Middle 



evaluation has been conducted by the use of local: district 

I' i ^ ■■■ ' ; * l ; 

■Department of Education personnel, and an out-of-state 



endent of the Clover School District and the principal 
School have worked closely with the science coordinator 
in the implementation of the project. Classroom visitation and consul- 
tation with the coordinator have been the primary means utilized by these; 
individuals. Herb' Tyler, Field Testing Coordinator of the Region V 
Educational Services Center has served to assist in project implementation 
and to provide feedback and suggestions for project improvement. Dr. Donald 
Rubier , science; consultant of Furman University has served ip:an 
advisory capacity itp the project during the school year. 
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B. Product Evaluation 



Objective: To increase the science achievement among 132 fifth, sixth, 

and seventh grade pupils enrolled in the Clover Middle 
School as follows: 

a. Fifth .grade from mean of 5.1 to mean of 6.5 

b. Sixth grade from mean of 6.5 to mean of 7.5 

c. Seventh grade from mean of 7.7 to mean of 3.5 

as measured by the Stanford Science Achievement Test 
through the provision of a science program utilizing 
laboratory experiences in a discovery approach* 

In order to determine whether or not there had been increased achieve- 
ment in science .during the academic year, the Stanford Science Achieve- 
ment Test was administered to the six experimental classrooms and the 
four control classrooms as a pre-test and a post-test. The pre-test 
was administered on October 3, 1969; the post test was given on May 
3, 1970. Equivalent Forms X and Y were used for the pre-test and 
post tests, respectively. Intermediate I level was used in the 
fourth grade, and Intermediate II in the fifth and sixth grades. 

In March, 1971 a post-test was administered and the post-test 
test from 1970 was utilized as a pre-test. 

The Stanford Science Achievement Test is a valid instrument 
for measuring achievement in traditional curricula. It is less 
valid , however, for measuring achievement related to the objectives 
of the new science curricula; its emphasis appears to be on the 



recall of facts 
science and the 
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and concepts rather than on the processes of 
functional application of concepts. The limitation 
of such tests for the purpose of evaluating experimental i programs 
like the Clover Science Program has .been ofteh noted. They continue 

-* 2 - m 
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T 



to be used, as in this case, because appropriate standardized 
instruments are not yet ; available . It *«*> be noted, also, 
that a test valid for the experimental program would suffer a lac 
of validity with relation to the control group science program; this 
is the dilemma inevitably faced when two programs with different 
objectives are compared. Scores on the Stanford Science Achievement 
Test, then, will reflect achievement in traditional objectives a 
offer a basis of comparison between the experimental and contr 

groups in such achisvcrrient • 
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the objective for 



6, 7) with the exception 



i . Analysis of Data 

Examination of Tables #1, #2, and #3 reveal that 
science achievement :has been met, with the experimental classes* The data 
was analyzed usings an IBM 7040 computer in conjunction with program 
MANOVA (Multi— Variate Analysis of Variance )from the University of Miami 
Biometric Laboratory statistical package 

The achievement data consist of II classes, 6 experimental classes, 
and 7 control classess — two classes in: each grade (5, 
of control grade IjS* iwhich contains 3 classes.' 

The data lend? themselves naturally to analysis by a three factor analysis 

’ * ' •“ t r • « ■ 

, ; ; * : \ « p • 

of variance design- qf grades x treatments, with teachers (classes); nested 

*1 is « ♦ i s ; V 9 a 1 • 

• ■ * 1 i % * i • ^ g 

within the cells.:; | Examination of the class i&earts in Table //I shoWs little 

] ' 1 y \\ t y * • 

teacher effect wiphin cells; however to increase generality the design was 
treated as though jteacher effects do exist, and the .. .ppropriate residual : 
error term was used: for analysis. Thus the results of this experiment gen- 
eralize beyond the: particular teachers used. 

Table #2 shqwisjthe combined class means, and graph //I plots these means. 
It is quickly ascejr gained by inspection of graph //I that there is 
difference between experimental anc control gropps. It should be 
that these groups were not equated at the start of the year. The 
was done on post-test scores of students who have participated two years 
in the program. Differences which were not apparent the first year (i.e. 
not statistically significant) may well be detectable this year. The only 
difference in the groups is the two years participation in the program,' 
thus it is reasonable to attribute group differences to the program— 

’ ; ;a j : ; ; II; 

but after two years! of operation. 

• ' • I ■ ; ■ j 

qonsideratip^ bf Table #3, the ANOVA table, shqwd that the gfadesdoi 
; differ in perfon^ape. Ttfis is entirely: r|TOnable] jias it is iceriaihly 

hot expected that ;|:he StbFgraders would well & (for examples) the ’7th 

• ' .* •• • 

* ■ „ ■ •; i.-> . 

graders. ;j i : : ' . . 
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emphasized 

analysis 
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Further consideration of Table #3 shows that there is a significant 
treatment effect; thus it can be said that students in the lab program 
score significantly^ better on achievement as measured by this test. 

Consideration of the interaction term in Table #3 shows no signi- 
. f leant interaction between grade and treatment, indicating that the 
treatment is equally : successful with all grades. While Graph #2 
depicts some interaction (in that it appears that the 6th grade 
! ex P erimental does better than expected), it must be concluded that 
this is sampling error which will not exist with different groups. 

It should be noted that regardless of whether or not there exists 

: interaction > the experimental group does better than the control at 
all levels. 1 
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The obvious post hoc comparisons to make are with the previous 
year’s data. Table #4 ; reproduces the data "for last year— pre-test 70, 
post-test 70— along with the data fort$his year. Graph 3 a » t) »c depicts 
£his data, \\> jl ; • 

Although no treiid; analysis was performed, the data appear to be 
linear in nature. While this is to be theoretically expected, with a 
gain of 1,0 grade level ftormal, it is clear that while this is ap- 
proximately true for I the control group, It is certainly not true for 

• * \ . ! ... • 

the experimental grcjup. It appears that the experimental group gains 
more than one grade jieVel pur year, Mathematically, it is said that 



the; data are linear if oir both groups, but the slope 



greater for 



the experimental group than foil 



the co 



of the line is 
ntrol group, . 
graph , 



■■ Two effects caiilible noted immediately from the 
1) The groups ;were approximately (statistically) equal .at the 
start of the experiment. 



2 ) Barring any i 



ceiling effect, It is to be expected that the 



difference between the experimental group and control group 
to increase ji linearly each year. 

It appears critical to this writer that it be determined if #2 
above is true. If #2 is correct, it appears beneficial to start this 
program as early as practical in the schools, in order that the students 
reap the benefits each year. If #2 is not correct, it would. seem im- 
portant to determine how long the program is beneficial, in order that 
the students remain in the program for the most ipprops*lste length 
of time before "switching" to another program, 

SUMMARY « 

experimental iprogram appears 

: * i \ !> : : f*! 

•II*;] !• *.\ i « »• 

enrolled in ithe experimental 
control; students. 
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classes scored higher 
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gains made by the 
yet oc curing. 

The effect appears 



students are cumulative, with no "leveling" 



to be beneficial at all grade levels 
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TABLE #1 

Leans Classes, Treatment ,; ; 8and Grkde 



[ • : ■ 


Grade 5 


Grade d 


>. Grade 7 


: BAr LAI i'.ENTAL : ? 

* * f K 






• * ■. 


I 


Class '1 j ? 


7.57 

n=21 


9.^9 

n=24 


10.22 

n=23 


Class: 2 \\ 


6.57 

n=22 


8.63' 

n=25 


3.82 

n=19 


■ CONTROL : j 










Class jl j j 


5.25 

n=26 


5.36 
n s 3 




3.01 

n=19 


: Class \Z j [• 


4.78 

n=15 


5.10 

rfal5 




7.42 
n= 5 


: Class ;3 i 




7.57 







n»ll 

TABLE #2 
Leans by Treatment and Grade 



LXPERI K 3NTAL 
CONTROL 



Grade 5 


Grade 6 


Grade 7 


7 • 06 
n=43 


9.05 

n=49 


9.58 

n=bz 


5.09 

n=4l 


5.96 

«s34 


7.88 

n=24 
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TABLE #3 
: : . ANAr ' T ' OF VARIANCE TABLE 



• SOURCE 
' Treatment 

’ Grade 

Treatment x Grade 
Residual 
Total 



SUM jOF SQUARES 
: : 358.97 

; ‘ ;■ 251.07 
20.25 
; : 86.29 

!f ; 716.57 



D.F. 

1 

2 

2 

7 

13 



MEAN SQUARE 
358,97 
125 j 53 
10.13 
12.33 



F 

29.12 

10.18 

.82 



P 

.001 

.01 

NS 
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riiS- (? 0 ) 


-.-Col ( 70 ) 


POST; ( 71 ) 


Experimental 










Grade 4 ( 5 ) 




: : 3*9 


5.1 


7.1 


Grade 5 ( 6 ) 




•' /L,.d 


6.8 


: 9.1 


Grade 6 (?) 




: ■ ;d.l 


7.7 


9.6 


Control 






• 




Grade 4 ( 5 ) 




: 3.7 


4,6 


: 5.1 


Grade 5 ( 6 ) 




ji ;^.6 


5.5 


6,0 


Grade 6 (?) 




; | j 6.2 


7.2 


i 7.9 




* 






• 






*i~ocjra, 



ma 



r 



o 

ERIC 



12 

iio. 



Jk. 







— - 



r 




TREATMENT 



4 



Objective: 



To ; determine the degree to which student and teacher attitudes 
abbiiit science are changed -as a result iof teaching science 

I ‘ 

concepts by laboratory techniques. ■ 



Student Attitudes; •; 



In order to measure possible changes in student Attitude toward science, 

the Aims-of-ScienicijeH Learning Attitude Scale was administered as a pre-test 

' '» 

■ !* i » ; 

in October, 1969,: and as a post-test in April, 1970 and this is an empirical 

jl j -I 

\ \ ji \ • \ 

spale; that is, iitji is composed of items which h frve been demonstrated to 



fifth, 



containing 



discriminate between two criterion groups — one a group of fourth, 

y. H : 

and sixth grade children identified by teachers as most exemplifying a 

) . M • 

learning attitude -related to several of the basic objectives of science 
education, the other a group of fourth, fifth, and sixth graders identified 

I • ;i 1 N " 

. , • 1 ■ * * 

by teachers as leajst exemplifying such an attitude. It is a Likert-tupe , 

scale, composed of! 28 items each of which is scored from 1-5, and 

1 ii : . ' 

«] • 

both positive and ^negative items. Responses to each item are “Very much 

! |i ' ! 

like me, something like me, Not sure, Not much like me, Not at all like me." 
High scores indicate a positive attitude. With the addition of a 29th 
item for this administration* the range of possible scores is 29-145. 

Number 29 is a simple obvious item, "Science is one of my favorite subjects." 

The attitude .data naturally lend themselves to a three factor aralysis 
of variance, with teachers nested within treatment and groups. A' sim- 
plfying assumption was made (on the bails of tfye previous year’s data) 

i 

that there were no teacher effects independent of the group effects, and 
the teacher factor was dropped—leaving a reduced 2x3 factorial analysis 

I 

of variance, of treatment x grades. The cell means are shown in Table #1. 



v* '! 
« ' 



The within-cell y^rl 



to 199.25. 



/ 



The 
MANOVA. . 



data wejrfe 



iances were homogeneous with pooled variance equal 



analyzed using the ptievl^usly referred to program— f: 

.• • :: 

■ ■* • * . , 

it is cljbar from: Table if 2 that :thej|only significant effect was 

j .' ! ' • * tm * J 

treatment; i.e. I the experimental group scor|d significantly better than 

• -ta 1 
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the control group.: ^ There was nonsignificant grad, effect or interaction 

E? ;• . •= ; • i : 

effect between graces and treatment. i- 

The conclusiii being that students in the experimental condition 

score significantil tetter than the control group with respect to science 

attitude as measulloy this test; and the effect is totally independent 

■ * ». 1 , 

' ■ ' 1 

of grade. • ; ji : 

n ».il W «u ■' *» "•?- *“* *1 

«... u . •*»* V ««— “ W-. b <»««•»- 

ij .sufficiently pronounced to show significance. p ra P^ ; 
the effect was notj ^ufricxenciy p 

n plots the cell Wans in Table #1 by treatment. It is clearly shown j 
! that the experimental group had higher attitude scores for all: groups. ; : 
i j[he apparent intijadion is exaggerated by the expanded scale Cf f. ordinate 

•• I 1 I i; * 

’ of the graph. ! ;j j 1 i 

: The obvious ! Ut hoc comparisons to mahe are with last year's students 

(actually, the same students-with each group being one year behind this 
present grade level). Table *3 reproduces last year's test data <pre and 
post) in addition to the data for this year. *ecall that last year the 
trend was for the students to decline in average score as the year pro- 
gressed, with the experimental group showing less decline than the control 
gr oup, thus achieving a net "positive" effect between groups.: Caparison 
of the data for the present year with the past year reveals that this 
decline in science attitude (as measured by this test) appears to-be. 
continuing, although there is no statistical evidence to support this 
conclusion. Graph »a,b,c shows this trend clearly; along with the feet 

-■ • _ . m fn-Liinelv above 'the control group (i«e 

that the experimental group is unfailingly a 



uiau . ^ : , ; 

h as a more posiiUe attitude toward science). It appears lihely| that 
out this prograg jthe students; "attitude ^toward science" wojld f>b a| 

control group #el-i.e. lower than it p^fsently f . ; ]'• 

. •:>;'■! ■: .;•• * ■!.£!»'.. • •: . . :: 

■ ; : s'i • . j: : • : 



With- 

the 



-17- 19 



s UMMARY : 



The experimental group scored significa#y bet# than the control 
group with respec^ (to science attitude as measured by7the Aims-oMcience 
Attitude Scale. & effect is independent of: grade and grade * treatment 

A ' t _ 

1 'i ; ’ • 

interaction. i l : 

There appears# be a general decline in "positive attitude toward ^ 
science" over timkUn both the experimental and control groups. This : 
decline may indie# that there was no change indicated in the : att^tudee 
as reflected by |scale or that the scale jtself If# validity # 
the purpose for vftk-ch it is being used, j | | ’ I ' 
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i " TABLE #1 

KEAfte ON STUDENT ATTITUDE; INVENTORY 





Grade 5 


Grade 6 


Grade 7 




Experimental 

4 


■ ■ ■ 

It O 

•* 


100.23 

n = 48 


105.00 

n s 43 


101.72 
n = 135 


Control 


97.63 
W a 4l 

I V | 


97.32 
n ss 34 


98.80 : 
ri = 20 


97.76 
n a 95 




; ;93 . 93 
: ri a 85 


99.02 
n = 82 


103.03 
n = 63 







TABLE #2 












ANALYSIS OF VARIANC 


!E TABLE 








SOURCE 


SUM OF SQ E 


>.F. 


KEAN SQ 


F 


F 


Treatments 


950.13 


1 


950.13 


4.78 


.03 


Grades 


3^0.57 


2 


170.29 


.86 


NS 


Treatments x 


Grades 405.8? 


2 


202.94 


1.02 


NS 


Error 


44631.06 


224 


199.25 






Total 


46327.63 


229 












1 






y 

* 

4 



r 



* 

A 



r 



! ji 

>: : jl* 



’.'•y 



!■: s. 



ERIC 






19 



f 



•I". 1-.-T 



C'-'T 



TA2LS 5' 3 ‘ 

* -r-i-r- - t— : -N .1 - .. -> ^ 

■ — -j ■ j -i* il JL . JLslxJl 



'^( 70 ) pcs? (70) POST (71) 

cental 

i 



Grade ^ (5) 


10'’'. 3 


102.2 




100.1 


Oracle 5 (6) 


105.2 


102.5 




100.2 


Grade 6 ( 7 ) 


102;. 7 


102.6 




105.0 


Control 






- 




Grade ^ (5) 


103.2 


96.2 




97.6 


Grade 5 (6) 


1(50.3 


99.1 




97.3 


Grade 6 (7) 


b 

<\> 

• 

o 


102.5 




93. a 
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Teacher Attitudes^ 




Due to the relocation of original participating teachers and ^reassignment 
of other key personnel no attempt wa9 made to assess changes in teacher attitude. 
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| SUMMARY : • I 

The analysis $ the compiled date after two years of operation of . 

the program showed! !the iTollOVfiing rdSUVfcS. 

1) Although 'the general attitude toward science according to the 

attitude ijscale appears to he declining in both groups, 
experimental group showed a more positive attitude toward science 

than thd ^control group. ; 

2) The attitude toward science does not appear to differ 

\ ■ ' 

I . ,1 , 

1 ’I ' v *' . .1 ; 

grades . ; :■ ! :: 

3) The experimental group showed higher achievement test 

I ;» •• 

scores kian the control group. 

4) It appears that the control group Is making normal . 

j! * 

progress:;. 

5) It appears that the experimental group is making above average 
gains M performance; that these gains are linear and cumulative. 

• !i - , * 
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List schools and/or school districts which have adopted the 

j o ct j ves and n ct i v i t i • • s of t he pro j e ct . 

Visits to the project have beer made by school personnel from 
five school districts, At least one school district (Chester County) 
is committed to establish two laboratory type instructional units 
at the fourth grade level for the 1971-72 school year* Present plans 
indicate that these will be gradually expanded during the coming school 
years as teachers become aware of the ramifications of the use of tae 
laboratory techniques in Elementary Schools, Officials of the other 
four school districts have expressed an interest in development of 
similar programs but no firm plans have been established* 

3, Summarize the influence of the project* 

After one year of operation the evaluation of the influence of 
the project would be difficult to measure due to the fact that most 
of the activities ofrthe project have been "in-house” activities 
designed to insure successful implementation of project activities. 

As dissemination activities are expanded, it is expected that the 
project will influence other programs and groups to a measurable 
extent. Classes in science education and teaching methods at 
Winthrop College have visited and observed the program. Teachers 
and administrators from six school districts have visited and ob- 
served classroom procedures and activities. Video tapesare to be 
made of classroom activities and will be used in teacher training 
at the University of South Carolina Science Education classes* 

Articles appearing in major news media have resulted in inquiries for 
information from school districts in two states. A major article is 
scheduled to appear; in the national publication Amer ican Education. 
Inquiries are expected to result from this publication. 





